Examples
Example 1: creating a new project
In this exercise we will create a new project that will be used throughout the rest of this course. I highly encourage you to follow along with me.
- Use
projectr::proj_start() to initiate a new project called 20240722_sismid_repro. Set up a directory in a separate location using the argument data_dir. I typically store my data on OneDrive, but the idea is to put it in a secure location.
Run the following code in R
# Setting up a folder WITH a symbolic link to the data subfolder
projectr::proj_start(proj_dir = "~/icloud/Documents/projects/2024/20240722_sismid_repro",
data_dir = "~/onedrive/Data/2024/20240722_sismid_repro")
Next, open the new project by double clicking the .Rproj icon. This will open up a new Rstudio session with the working director set to that project folder. It will also set the working directory of the terminal tab to that folder.
- Download the data download script and save it in the
source folder of your new project directory as 01_data_download.R.
It would be fine to copy/paste the code for 01_data_download.R and saving it via point and click, but you can also do this using tools from the command line module by entering the following into the terminal:
echo '# install.packages("RSocrata")
library("RSocrata")
library(tidyverse)
# download longitudinal Covid WW concentration data from API
covid <- read.socrata(
"https://data.cdc.gov/resource/g653-rqe2.json",
app_token = Sys.getenv("TOKEN"),
email = Sys.getenv("EMAIL"),
password = Sys.getenv("PASSWORD")
) %>%
mutate(date_downloaded = Sys.Date())
# download cross-sectional Covid WW concentration data from API, which will be used to get county names
counties <- read.socrata(
"https://data.cdc.gov/resource/2ew6-ywp6.json",
app_token = Sys.getenv("TOKEN"),
email = Sys.getenv("EMAIL"),
password = Sys.getenv("PASSWORD")
)
## save intermediate data object and data data was accessed
save(covid, counties, file = here::here("data", "raw.Rdata"))' > source/01_data_download.R
Check that you have saved this script in the source folder using the terminal tab:
ls source
- Make an Rmarkdown document that knits to html called
final_report.Rmd and put it in the analysis folder of your project directory.
We will come back to the final_report.Rmd document later in the lecture.
Example 2: adding .Renviron variables
- Add a
.Renviron file to the root directory of your 20240722_sismid_repro project folder.
Open the terminal. I will use the terminal tab of the 20240722_sismid_repro project. First, check that your working directory is 20240722_sismid_repro.
pwd
If you are not in the correct directory use the cd command to move into ~\20240722_sismid_repro. Next, create and open the .Renviron file.
touch .Renviron
open .Renviron
- Edit the
.Renviron file by defining variables called TOKEN, EMAIL, an PASSWORD that contain your app token, and email and password used to obtain your app token.
Your edited .Renviron file should look something like this:
PASSWORD="password333"
EMAIL="julia.wrobel@emory.edu"
TOKEN="K1MVpmwDDeefZ0vPuYk2wRN"
Close your R session and then reopen it by double-clicking 20240722_sismid_repro. Your environment variables defined through .Renviron should now be defined.
You can check by typing the following into the R console:
Sys.getenv("EMAIL")
## [1] ""
This should print out your email address.
- Add the
.Renviron file to your .gitignore file.
This is not necessary for accessing the environment variables you just defined, but will be important for later in the course when we start using git and GitHub. You do not want to accidentally put your .Renviron on GitHub, and by adding the file to .gitignore we can avoid this mistake.
To do this, go to your terminal and execute the following two lines of code:
echo "" >> .gitignore # ensures you are writing on a new line
echo ".Renviron" >> .gitignore
Alternatively, you can just open the .gitignore file and add .Renviron on a new line. Sometimes I find this to be simpler.
- Check that the code in your
01_data_download.R file will run.
Example 3
- Using the
projectr template, make an Rmarkdown document called exploratory_analysis.Rmd and put it in the analysis folder of your project directory. Load and explore the data. Take notes on what you learn. Add in brief descriptions of the key variables.
Might be helpful to reference the page about the data.
- Download the data cleaning script and save it in the
source folder of your new project directory as 02_data_cleaning.R.
echo '# set up a variable to define which state you want to analyze
state = "ga"
# download raw data
source(here::here("source", "01_data_download.R"))
# grab only observations from the specified state
covid = covid %>%
filter(grepl(state, key_plot_id))
# only include columns from counties dataset we are interested in
counties = counties %>%
filter(grepl(state, key_plot_id)) %>%
select(key_plot_id, wwtp_id, county = county_names,
county_fips, population_served) %>%
distinct()
# merge covid data with the county label information
# convert variables from character to numeric
# concentration variable more intuitive name
covid = left_join(covid, counties, by = "key_plot_id") %>%
select(-key_plot_id) %>%
mutate(pcr_conc_lin = as.numeric(pcr_conc_lin),
population_served = as.numeric(population_served)) %>%
rename(concentration = pcr_conc_lin)
## save intermediate data object and data data was accessed
save(covid, file = here::here("data", "clean.Rdata"))
' > source/02_data_cleaning.R
Download the data analysis script and save it in the source folder of your new project directory as 03_data_analysis.R.
Download the data vizualization script and save it in the source folder of your new project directory as 04_data_vizualization.R.